AUTOMATIC LAYOUT GENERATION FOR PHOTOBOOKS 

BACKGROUND 

[0001] Photobook software applications are available which can accomplish 
aspects of photobook creation such as automatic layout, addition of annotations 

5 and printing of the photobook or publication to a website. Printed photobooks can 
be bound and printed with text annotations. Available photobook services on the 
World Wide Web allow the user to arrange their photos into a photobook with 
annotations with a few automated features. These web services then print the 
user's photobook and deliver the photobook to the user. 

10 [0002] Examples of web photobook services include www.printlife.com, 

www.ememories.com and www.photoworks.com. The photoworks service allows 
a user to assemble digital photos one to a page in a printed photobook, with a title 
page, which is then mailed to the user. 

[0003] Other photobook software can be downloaded or purchased to assist the 
15 user in arranging photos and printing the photos as a book or publishing the 

photos on a website. One example of photobook software is the PhotoRecord™ 
software distributed with certain Canon™ digital cameras and printers. The 
PhotoRecord™ software includes some automatic layout of the photographs on the 
pages of a photobook and printing of the photographs in a photobook. 
20 [0004] Kodak® Auto Album and Kodak® Memory Album software provides 

basic photo album creation capabilities including simple auto layout where the user 
can change the page layout templates. The final printed photobook is then 
available by mail. 
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SUMMARY 

[0005] A method for automatic layout of a photobook page is disclosed. An 
exemplary method includes receiving a number of images for placement onto the 
photobook page, the photobook page having a first dimension and a second 

5 dimension wherein the first dimension is greater than the second dimension; 

approximating a square root of the number of images; determining a total number 
of page divisions along the first dimension of the photobook page, wherein the 
total number of page divisions corresponds to the approximated square root; 
evaluating whether the photobook page is to be divided into a regular array of 

10 image areas using a modulus of the number of images and the square root; 

determining a number of image areas to be included in a page division using a 
ratio of the number of images to the approximated square root; and distributing 
the images automatically on the photobook page among the multiple image areas. 
[0006] In an exemplary embodiment, a computer readable medium having a 

15 program for producing a photobook by executmg a procedure is disclosed. The 
procedure includes receiving a number of images for placement onto the 
photobook page, the photobook page having a first dimension and a second 
dimension wherein the first dimension is greater than the second dimension; 
approximating a square root of the number of images; determining a total number 

20 of page divisions along the first dimension of the photobook page, wherein the 
total number of page divisions corresponds to the approximated square root; 
evaluating whether the photobook page is to be divided into a regular array of 
image areas using a modulus of the number of images and the square root; 
determining a number of image areas to be included in a page division using a 

25 ratio of the number of images to the approximated square root; and distributing 
the images automatically on the photobook page among the multiple image areas. 
[0007] An exemplary system for automatic layout of a photobook page having a 
first dimension and a second dimension, wherein the first dimension is greater 
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than the second dimension, comprises means for receiving a number of images for 
placement onto a photobook page; and means for processing the images to 
approximate a square root of the number of images, to determine a total number 
of page divisions along the first dimension of the photobook page wherein the total 

5 number of page divisions corresponds to the approximated square root, to 

establish whether the photobook page is to be divided into a regular array of 
image areas using a modulus of the number of images and the square root; and to 
determine a number of image areas to be included in a page division using a ratio 
of the number of images to the approxhnated square root, wherein the processing 

10 means distributes the images automatically on the photobook page among the 
multiple image areas. 

RRTHF DESCRIPTION OF THE Dl^AWTNG FIGURES 
[0008] Preferred embodiments will now be described in greater detail with 
reference to the accompanying drawings, in which like elements bear like 

15 reference numerals, and wherein: 

[0009] Figures lA-lD illustrate an exemplary method for automatically laying 
out a page of a photobook. 

[0010] Figure 2 is an exemplary operation shown with reference to Figure IB, 
which refines a position of images within a photobook page. 
20 [0011] Figure 3 is an exemplary embodiment of a system for generation of a 
photobook page. 

DETAILED DESCRIPTION 
[0012] Figure lA illustrates an exemplary method 100 for automatically laying 
out a page of a photobook. In an operation 102, a number (n) of images are 
25 received from a source (for example, images from a user, digital camera or the 
like) for placement on a photobook page and can be optionally stored on any 
device having memory. The photobook page includes a first dimension and a 
second dimension where the first dimension is greater than the second dimension. 



In operation 104, the method 100 approximates a square root "m" of the number 

of images "n". 

[0013] With reference to Figure 3 and the system 300 shown therein, means are 
provided for receiving images 302 from, for example, memory 303 via a path 

5 (such as a computer bus) 305 and an input, such as any suitable interface 322 

including but not limited to an external connection or an internal bus interface of 
the processor 304. The images can be input to the memory 303 via path 307, or 
alternately, can be supplied directly to the interface 322 via a path 309. 
[0014] The Figure 1 method 100 can be implemented by the processor 304. The 

10 processor 304 can be any device capable of selecting and/or receiving images local 
or remote to the processor, such as a personal computer or the like. The images 
302 can be received as any type of digital information stored in memory, such as 
digital photographs, scanned fihns and articles, photographs, slides, electronic 
documents or the like, or can be analog images which are converted to a digital 

15 format. The images can also be any type of electronic document, such as text, 
graphs, tables, and the like. 

[0015] In this example, the processor 304 receives ten images in the operation 
102. In the operation 104, the processor 304 approximates (for example, by 
rounding up or rounding down to the nearest integer) the square root m of the 

20 number of images 302. For example, where rounding up is used, the square root 
is approximated as 4 (f / 10] = 4) using means for mathematically processing, 
such as an arithmetic logic unit 320, within the processor 304. 
[0016] Once the square root of the number of images is approximated, the 
processor 304 determines a total number of page divisions along the first 

25 dimension of the photobook page. In an exemplary embodiment, the total number 
of page divisions is determined in the Figure lA operation 106, and corresponds 
to the approximated square root. 
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[0017] The first dimension and the second dimension of the photobook page can 
be provided by manual input via a user interface of the processor 304, such as a 
keyboard, a touch screen, a scanner used for scanning of a photobook sheet of 
desired dimensions, or via any suitable input device. The first dimension and the 

5 second dimension can be stored in the memory 303, and can correspond to any 
dimension of the photobook page such as the height (that is, the length) of the 
photobook page, and the width of the photobook page, as determined when 
viewing the page in a desired orientation for inclusion in a photobook. 
[0018] Where, for example, the height and width dimensions for a given 

10 orientation of the page in a photobook have been provided, the processor 304 can 
ascertain whether the height of the photobook page is greater than the width of the 
photobook page. If the page height is greater than the page width, then the axis 
along the height of the page is the first dimension and is assigned as the major axis 
of the page. An axis along the width is the second dimension and is assigned as 

15 the minor axis of the page. Otherwise, an axis along the width is assigned as a 
major axis and an axis along the height is assigned as the minor axis. 
[0019] During implementation of the method 100, dimensions for a photobook 
page 306 can be supplied from memory 303 to the processor 304 or any other 
suitable input. In this example, the photobook page 306 has a dimension H (for 

20 example, a height of 8.5 inches) and a dimension W (for example, a width of 11 
inches). The processor 304 determines that the width of the photobook page 306 
is greater than the height. Thus, the width of the photobook page is assigned as 
the major axis and the height is assigned as the minor axis. 
[0020] In the exemplary Figure IB flow chart, after the number of page 

25 divisions along the first dimension have been determined, operation 116 is 

performed wherein the method 100 evaluates each page to determine whether a 
resulting grid of image areas will be regular or irregular. A regular grid is one 
wherein each page division possesses the same number of image areas. For "n" 



images, where the modulus is calculated as the remainder of n/m, "n modulus m" 
will be zero for a regular array. 

[0021] In addition to being used to identify a page grid as regular or irregular, 
the modulus is used in the flow chart of Figure IB to determine the number of 

5 page divisions which will have multiple image arrays. If, for example, n= 1 or 2, 
the result of the Figure IB operation is that the grid will be regular since the 
remainder of n/m is zero, and so there is no determination of multiple image areas 
within a page division. If n=3, the result of the operation 116 is that the grid will 
be irregular since "n modulus m" is not zero, (that is, the remamder of n=3/m=2 

10 is 1), and there is a determination of multiple image areas within one of the two 
page divisions. If n=4, "n modulus m" is zero such that the resultant grid is 
regular, and there are multiple unage areas within each page division. If n=5, "n 
modulus m" is non-zero (that is, the remainder of n=5/m=3 is 2) such that the 
resultant grid is irregular and there are multiple image areas in two of the three 

15 page divisions. Before discussing the determination of multiple images in an 

irregular array, the determination of multiple image areas in a regular array will 
be discussed. 

[0022] When the method 100 determines that a regular array, or grid, of image 
areas can be established on the page, the method 100 performs an operation 131 of 

20 Figure IC. Otherwise, when the method 100 determines in the operation 116 that 
an irregular grid of image areas is to be established, the method 100 performs an 
operation 118. Those skilled in the art will appreciate that the exact order of 
operations shown in the method 100 is by way of example only, and that these 
operations can be repositioned in any manner desired. 

25 [0023] Where the method 100 determines in operation 116 that the grid is 
regular, the method 100 divides the photobook page into a regular array (for 
example, rectangular array) or grid of image areas, in operation 131 of Figure IC. 
The images are then distributed among the image areas. The grid is laid out using 



the approximated square root "m" of the number of images from operation 106 to 
create the divisions of the grid along the first dimension. A ratio of the number of 
images "n" to the approximated value of the square root of the number of images 
"m" can be used to establish the number of image areas within divisions of the 
5 grid along the second dimension (that is, n/m). 

[0024] For example, where twelve images are provided, an approximated (for 
example, rounded up) square root of the number of images is four 12] = 4). 
Thus, a first value used to lay out the page divisions along a major axis of the grid 
is four (that is, four page divisions are established along the major axis). The 
10 method 100 determines the second value by dividing the niraiber of images (n = 
12) by the approximated square root value (m = 4) for a second value of three 
(12/r/l2l = 3). Thus, the minor axis of the grid includes three image areas in 
each page division. As such, the method 100 lays out the photobook page with a 
regular grid of four-by-three image areas. 
15 [0025] In the operation 132, the method 100 determines whether there is only a 
single input image (for example, only one image is provided in the operation 102 
such that n= 1). If only one image is provided, the method 100 performs an 
operation 138 where the image is scaled to fit the photobook page with, or 
optionally without, a border. During the operation 138, the images can be scaled 
20 using any suitable technique, such as a data resolution synthesis algorithm as 

disclosed in U.S. Patent Nos. 6,058,248 and 6,075,926, the disclosures of which 
are hereby incorporated by reference in their entireties. With such an algorithm, 
image processing using image interpolation such as colorimetry constructs and 
multidimensional color space data interpolation can be used. These interpolation 
25 techniques include specifying an interpolating function which approximates the 
original image by sampling across a range of the source image data. During 
scaling operations, the aspect ratio of the image can, if desired, be changed. The 
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scaling operations can include either upscaling or downscaling as desired, and as 
suitable for the image area under consideration. 

[0026] When the method 100 determines that more than one image has been 
provided in operation 102, the method 100 performs a distribution of the images 

5 among the image areas in operation 133, and performs similar scaling operation 
134. In operation 134, the method 100 scales each image to fit within a 
designated image area having a border in a manner similar to that discussed with 
reference to the operation 138. The method 100 then positions each image within 
a designated image area of the grid in the operation 136. Upon completion of 

10 either the operation 136 or the operation 138, the method 100 performs an 
operation 140 to output the photobook page. 

[0027] Referring to Figure IB and the operation 116, when the method 100 
determines that an irregular array of image areas is to be established, the method 
100 performs a different procedure for establishing image areas, beginning with 
15 operation 118. This would be the case where, for example, a modulus between a 
number of unages (e.g., 10 images) and an approximated square root of the 
number of images (e.g., m=4) is 2. 

[0028] In operation 1 18, a grid for an irregular array is established by assigning 
the number of page divisions determined along the first dimension of the 

20 photobook in operation 106 to a major axis of the photobook page. This operation 
of actually assigning page divisions can, of course, optionally be performed in 
operation 106, at the same time the total number of page divisions are determined. 
The major axis corresponds to the greater dimension, such as a first dimension, of 
the photobook page to which a layout is to be applied. For example, with an 

25 approximated square root m=4, the method 100 assigns four as the number of 
page divisions used to establish image areas along a major axis in the operation 
118. In this example, the dimension W is greater than the dimension H of the 
photobook page. 



[0029] After completing operation 118, the method 100 performs an operation 
120 which evaluates each page division for further division into a multiple number 
of image areas by calculating rounded-up and rounded-down approximations of the 
ratio of n/m. In operation 120, the page will be divided into page divisions having 

5 different numbers of image areas. 

[0030] To determine the number of image areas in each page division in 
operation 120, the method can take a ratio between the number of images "n" and 
the approximated square root "m" of the number of images and round up this ratio 
to select the number of image areas in a first set of page divisions. Likewise, in 

10 the operation 120, the method rounds down the ratio between the number of 
images "n" and the approximated square root "m" of the number of unages to 
select the number of image areas in a second set of page divisions. For example, 
with n= 10 and m=4, the rounded up n/m= f 1=3, and the rounded down 
n/m=Ln/m J=2. 

15 [0031] In operation, 122, the mefliod uses the modulus calculated in operation 
116 to determine the number of page divisions which will have the rounded up 
f n/m "I number of image areas, and the number of page divisions which will have 
the rounded down L n/m J number of image areas. Where "n modulus m" results 
in a non-zero value, the modulus will represent the number of the page divisions 

20 to be designated as having a number of image areas corresponding to the rounded 
up ratio, and the remaining number of page divisions will be designated as having 
a number of images corresponding to the rounded down ratio. In an example with 
11 images, and four page divisions (m=4), "n modulus m" is equal to 3. The 
method will therefore determine that three page divisions will have the rounded up 

25 ratio of 3 image areas. The remaining page division will have a number of image 
areas corresponding to the rounded down ratio of 2. 

[0032] In operation 123, a random selection is made for a first set of page 
divisions among the total divisions which will have the rounded up number of 



image areas (e.g., the first, second and third page divisions, or any three of the 
four page divisions). Similarly, by default, a second set of page divisions which 
have the rounded down number of image areas is selected. Thus, in the above 
example, the three page divisions which will have the 3 image areas are randomly 
5 selected. 

[0033] In operation 125, the photobook page is divided using the grid into "m" 
page divisions, each having [n/m] or Ln/mJ image areas, as implemented in 
operation 126. In operation 127, the method distributes, or assigns, the images 
automatically on the photobook page among the multiple image areas. 

10 [0034] The foregoing operation is also illustrated by reference to Figure 3, 
wherein a first set of image areas are calculated by rounding up the ratio of the 
number of images 302 to the approximated square root of the number of images 
302. The method 100 calculates the second set of image areas by rounding down 
the ratio of the number of images 302 to the approximated square root of the 

15 number of images 302. In this example, where the modulus is 2, the resulting 

number of unage areas in a first set of two page divisions is determined to be three 
by rounding up the ratio of the number images "n" to the approximated square 
root "m" ([10/ [^^ 10] 1 = 3). Likewise, the resulting number of image areas in 
the second set of two remaining page divisions is determined to be two by 

20 rounding down the ratio of the number of images "n" to the approximated square 
root "m" (L 10/ [^^ 10] J = 2). As such, the method results in a page having four 
page divisions, with three image areas in each of two page divisions and with two 
image areas in each of the remaining two page divisions (see Figure 3). 
[0035] In operation 128 of Figure IB, the method scales each unage to fit within 

25 an image area in a manner as discussed with reference to the operation 138 of 

Figure IC. Once each image is scaled to fit within an image area, the method 100 
performs operation 129 where each image is automatically positioned within an 
image area. Upon positioning each image within an image area (e.g., centered 
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within the area, or at any desired initial position), the method 100 performs an 
operation 130. In the operation 130, the method refines positions of the images 
within the photobook pages. 

[0036] Figure 2 is an exemplary embodiment illustrating the operation 130 and 
a method 200 which refines a position of images within a photobook page. The 
method 200 generates a random number between a positive border width and a 
negative border width in each of the two dimensions. In one example, a border 
width modifier of from negative 1 to positive 1 can be used as a border width 
multiplier in an operation 202. The method 200 provides a border width in an 
operation 204. Any border width desired can be used. For example, a border 
width input by the user can include, without limit, a border width which results 
when an image of given size is centered within its image area. 
[0037] In operation 206, a position offset value is calculated using the random 
number and the border width value. In an exemplary embodiment, the position 
offset value provides positional movement of an image within an image area, and 
can be used to randomize the placement of the image within its image area on the 
page layout. Once the method 200 calculates the position offset value on a given 
image within a given image area in the operation 206, the method 200 determines 
a revised position coordinate value of the image in an operation 208. This 
procedure can be performed along each dimension of an image. The method 
determines whether or not additional coordinate values are to be determined for a 
given image, and/or for additional images on a page, in an operation 210. If the 
method 200 determines that additional coordinate values are to be determined, the 
method repeats operations 202 to 208. If the method 200 determines in the 
operation 210 that additional coordinate values need not be determined for a given 
page, the method 200 proceeds to the operation 140 of Figure ID. 
[0038] As an example, assume that in operation 202, the method 200 generates 
a random number of, for example, 0.5 which is between -1 and 1 and which can 
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be used as a border width modifier along a first dimension (e.g., height) of a 
given image. In the operation 204, a border width of 0.5 is provided (e.g., by the 
user, or automatically using some criterion, such as centering of the image). A 
position offset value is then calculated along the first dimension within the image 
5 area under consideration by multiplying the random number of 0.5 with the border 
width 0.5. As such, the method 200 calculates the position offset value as 0.25 
(0.5 X 0.5). The method 200 then repeats this process for a second dimension 
(e.g. , along the width) of the image area. For example, a random number of 0. 1 
can be selected for modifying the border width, where 0.1 x 0.5 = 0.05. New 
10 coordinate values are then determined for the image in the operation 208. 

[0039] Making reference to Figure 3, assume the image 302a placed on the 
photobook page 306 has initial x,y coordinate values of 2, 2 relative to the 
photobook page. In the operation 208, the image 302a is moved such that the 
coordinates are 2.25, 2.05. The coordinate system used for photobook page 306 
15 is such that the dimension H defines a y axis and the dimension W defines an x 
axis. The coordinate system defined by the dimension H and the dimension W 
can, for example, be considered to have an origin at a point 306a. Once the 
method 200 determines the new coordinate value for an image using calculated 
position offset values, the method determines in the operation 210 that additional 
20 coordinate values are to be determined for the images 302b through 302j. As 

such, the method 200 repeats operations 202 to 208 for each of the images 302b to 
302j. After repeating operations 202 through 208 for the images 302b through 
302j, the method 100 performs the operation 140 of Figure ID. 
[0040] In operation 140, the method 100 outputs a page of the photobook. 
25 Upon completion of the operation 140, the method performs an operation 142 

where the method 100 determines whether additional images for additional pages 
are necessary. If the method 100 determines that additional pages are necessary 
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for additional images, the method repeats operations 102 through 142. Otherwise, 
the photobook page is complete. 

[0041] The functionality described herein can be embodied by computer- 
executable instructions, such as program modules, that are executed by computers. 

5 Program modules can be stored, for example, that include routines, programs, 

objects, components, data structures, and so forth that perform particular tasks or 
implement particular abstract data types. The instructions and/or program 
modules can be stored at different times in various computer-readable media that 
are either part of a computer implementing the software application or that can be 

10 read by the computer. Programs can be stored, for example, on floppy disks, CD- 
ROMs, DVD, or any form of storage media, suitable for being loaded into the 
memory of a computer, or accessed by a computer. 

[0042] Exemplary embodiments described herein include any type of computer- 
readable media suitable for containing programs, and/or modules for 
15 implementing the operations in a microprocessor or other data processor. 

Exemplary embodiments can also be unplemented as a con^uter which has been 
programmed as described herein. 

[0043] While the invention has been described in detail with reference to the 
preferred embodiments thereof, it will be apparent to one skilled in the art that 
20 various changes and modifications can be made and equivalents employed, without 
departing firom the present invention. 
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